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Abstract. Certain signal classes such as audio signals call for signal repre- 
sentations with the ability to adapt to the signal's properties. In this article 
we introduce the new concept of quilted frames, which aim at adaptivity in 
time-frequency representations. As opposed to Gabor or wavelet frames, this 
new class of frames allows for the adaptation of the signal analysis to the local 
requirements of signals under consideration. Quilted frames are constructed di- 
rectly in the time-frequency domain in a signal-adaptive manner. Validity of the 
frame property guarantees the possibility to reconstruct the original signal. The 
frame property is shown for specific situations and the Bessel property is proved 
for the general setting. Strategies for reconstruction from coefficients obtained 
with quilted Gabor frames and numerical simulations are provided as well. 



1. Introduction 

QUILT (verb): (a) to fill, pad, or line like a quilt 
(b) to stitch (designs) through layers of cloth 

(c) to fasten between two pieces of material 

Natural signals usually comprise components of various different characteristics and 
their analysis requires judicious choice of processing tools. For audio signals time- 
frequency dictionaries have proved to be an adequate option. Since orthonormal 
bases cannot provide good time- frequency resolution, [22], time-frequency analysis 
naturally leads to the use of frames. Most classes of frames commonly used in 
applications, be it wavelet or Gabor frames, feature a resolution following a fixed 
rule over the whole time-frequency or time-scale plane, respectively. The concept 
of quilted frames, as introduced in this contribution, gives up this uniformity and 
allows for different resolutions in assigned areas of the time-frequency plane. 
The primary motivation for introducing this new class of frames stems from the 
processing of audio and in particular music signals, where the trade-off between 
time- and frequency resolution has a strong impact on the results of analysis and 
synthesis, see [27J [TOj HSU |28j |2l] . The well-known uncertainty principle makes the 
choice of just one analysis window a difficult task: different resolutions might be 
favorable in order to achieve sparse and precise representations for the various signal 
components. For example, percussive elements require short analysis windows and 
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high sampling rate in time, whereas sustained sinusoidal components are better 
represented with wide windows and a longer FFT, thus more sampling points in 
frequency. 

Several approaches have been suggested to deal with the trade-off in time- 
frequency resolution. The notion of multi-window Gabor expansions, introduced 
by Zibulski and Zeevi, [31], uses a finite number of windows of different shape in 
order to obtain a richer dictionary with the ability to better represent certain char- 
acteristics in a given signal class. Another approach is the usage of several bases 
in order to best describe the components of a signal with a priori known character- 
istics, see [9]. All these approaches, however, stick to a uniform resolution guided 
by the action of a certain group via a unitary representation. For quilted Gabor 
frames we give up this restriction and introduce systems constructed from globally 
defined frames by restricting these to certain, possibly compact, regions in the time- 
frequency or time-scale plane. The idea of realizing tilings of the time-frequency 
plane has been suggested in [3] and [22], however, these authors stick to the con- 
struction of orthogonal bases. In this case, every basis function corresponds to a 
particular tile. We will achieve a wider range of possible partitions, windows and 
sampling schemes by allowing for redundancy. Thus we aim at designing systems 
that can optimally adapt to a class of signals considered. As a particular example 
of quilted frames, the notion of reduced multi-Gabor frames was first introduced 
in [11] and recently exploited in [23] • Note that this model allows, for example, a 
transform yielding constant-Q spectral resolution, which is invertible, as opposed 
to the original construction [5]. Reduced multi-Gabor frames were successfully ap- 
plied to the task of denoising corrupted audio signals, see [SO]- The processing of 
sound signals also yields a motivation for the next step in generalizing the idea to 
quilted frames, which allow arbitrary tilings of the time-frequency plane, see [25] . 
Quilted frames also bear theoretical interested in themselves and should be com- 
pared to constructions such as fusion frames [7] and the frames proposed in pp. 
In fact, the construction of quilted frames provides constructive examples for the 
models presented in these contributions. 

For the mathematical description of quilted frames, we start from principles of Ga- 
bor analysis [2D]. The idea for the construction of quilted Gabor frames is inspired 
by the early work of Feichtinger and Grobner on decomposition methods [THl [TP] 
and recent results on time-frequency partitions for the characterization of function 
spaces [T2J, [13] : 

Assume that a covering (Q r ) re i of the phase space M. 2d is given. To each member 
of the covering a frame from a family of Gabor frames is assigned, hence, the new 
system locally resembles the original frames. The resulting global system will be 
called a quilted Gabor system. We conjecture that these systems may be shown to 
constitute frames under certain, rather general conditions. In this paper we will 
show the frame property in two special cases and proof the existence of an upper 
frame bound for a general setting. 

The rest of this paper is organized as follows. Section 2 provides notation and 
gives an overview over basic results in Gabor analysis. Section 3 introduces the 
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general concept of quilted Gabor frames. In Section 4, the existence of an upper 
frame bound (Bessel property) for general quilted frames is proved. In Section 5 
and Section 6, a lower frame bound is constructed for two particular cases, namely, 
the partition of the time-frequency plane in stripes and the replacement of frame 
elements in a compact region of the coefficient domain. Finally, Section 7 presents 
numerical examples for these cases. 

2. Notation and some basic facts from Gabor theory 

We use the normalization f(co) = J Rd f(t)e~ 2muJt dt of the Fourier transform 
on L 2 (M d ). and T x denote frequency- shift by u and time-shift by x, re- 

spectively, of a function g, combined to the time-frequency shift operators 
tt(A) = M w T x g(t) = e 2mtuJ g(t - x) for A = (x, u) G R 2d . 

The Short-time Fourier transform (STFT) of a function / G L 2 (M d ) with 
respect to a window function g G L 2 (M d ) is defined as 

(1) V P /(A)= / f(t)g(t-x)e- M dt=(f,7r(X)g). 

A lattice A C M. 2d is a discrete subgroup of M. 2d of the form A = AZ 2d , where A 
is an invertible 2d x 2<i-matrix over R. The special case A = aZ d x (3Z d , where 
a, (3 > are the lattice constants, is called a separable or product lattice. 

A family of functions (gk)kez i n is called a frame, if there exist lower and 
upper frame bounds A, B > 0, so that 

(2) A\\f\\ 2 <Y,\(f,9k)\ 2 <B\\f\\ 2 for all / G L 2 (M (i ) 

fcez 

Assumption (J2]) can be understood as an "approximate Plancherel formula". It 
guarantees that any signal / G L 2 (IR d ) can be represented as infinite series with 
square integrable coefficients using the elements gi~. The existence of the upper 
bound B is called Bessel property of the sequence (gk)kez- The frame operator S, 
defined as 

Sf = ^(f,9k)9k 

kez 

allows the calculation of the canonical dual frame ('jkjkez = (S^g^k&z, which 
guarantees minimal-norm coefficients in the expansion 

(3) / = 5^</, ik)gk = ^2(f, 9k)ik- 

If A — B, the frame is called tight and f — \ Ylkif^ 9k) 9k- AVe refer the interested 
reader to Christensen's book [8] for more details on general frames. 
In the special case of Gabor or Weyl-Heisenberg frames, the frame elements are 
generated by time-frequency shifts of a basic atom or window g along a lattice A: 

9\ = tt(A)#. 

In this case we write S = S g , and S g = T*T g , where T g : / i-)- [(/, g\)]\ is the 
analysis operator mapping the function / G L 2 (IR d ) to its coefficients c(/)(A) = 
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Tgf(X). These coefficients correspond to the samples of the STFT on A. Its 
adjoint T* : [ca]aga ^ Saga c ^ n Wd * s the synthesis operator. For the Gabor 
frame generated by time-frequency shifts of the window g along the lattice A we 
write Q(g, A). 

We next introduce the concept of partitions of unity . A family (ip r )r<=x of non- 
negative functions with Ylr^rix) = 1 is called bounded admissible partition of 
unity (BAPU) subordinate to (B Rr (x r )) r( zZi if the support fl r of (ip r ) is contained 
in B Rr (x r ) for r G X, and (-B_R r (a; r )) rg j is an admissible covering in the sense of [H] 
i.e., Urex-^R r = ^ d and the number of overlapping B Rr (x r ) is bounded above 
(admissibility condition). In other words, with 

r* := {s : s £ X, B Rr {x r ) n B Rs {x s ) ^ 0}, 

for all r G X there exists no G N, called height of the BAPU, such that |r*| < no- 

For technical reasons, which do not eliminate any interesting example, we assume 
even more: for all p < oo the family (B Rr+p (x r )) r€ x should be an admissible 
covering of R d . More precisely, we assume throughout this paper that for each 
p > there exists n = n (p) G N such that the number of overlapping balls 
constituting the covering is uniformly controlled: \r*\ < n for all r G X, where 

r* := {s : s G X, B Rr+p (x r ) n B Rs (x s + p) ^ 0}. 

Obviously such coverings are of uniform height. 

Using the concept of BAPUs, we now turn to Wiener amalgam spaces, in- 
troduced by H. Feichtinger in 1980 (see [17] for an accessible publication). The 
definition of Wiener amalgam spaces aims at decoupling local and global proper- 
ties of L p -spaces. Let a BAPU (Vv)rez f° r ^ d be given. The Wiener amalgam space 
W(L p 1 l q ) is defined as follows: 

W(U,n(R d ) = {/ G Lf oc : WfWww = (X)ll/'Vv|l!)« < oo}. 

We will denote by W{C°, £P){R d ) C W(L°°, £P){R d ) the subspace of continuous, lo- 
cally bounded functions in W(L°°, £ p )(R d ). A comprehensive review of (weighted) 
Wiener amalgam spaces can be found in [23]. We note that in their most general 
form they are described as W(B,C), with local component B and global compo- 
nent C. Let us recall some properties which will be needed later on: 

• If B x C B 2 , d C C 2 , then W{B U C x ) C W(B 2 , C 2 ). 

• K5i*B 2 C B 3 , d * C 2 C C 3 , then W(Bi, Ci) * W(5 2 , C 2 ) C W(B 3 , Ca). 

A particularly important Banach space in time-frequency analysis is the Wiener 
Amalgam space W^L 1 , i 1 ). This space, also known under the name Feichtinger's 
algebra, is better known as the modulation space M^ 1 , with constant weight m = 1. 
It is often denoted by So in the literature and we will adopt this name in the present 
work. For convenience, we also recall the definition of Sq via the short-time Fourier 
transform. 
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Definition 1 (So). Let g be the Gauss-function g Q = e n W x W 2 . The space So(M. d ) 
is given by 



An in-depth investigation of So(IR d ) and its outstanding role in time- frequency 
analysis can be found in [15]. Note that 5o(lR d ) is densely embedded in L 2 (R d ), 
with ||/|| 2 < \\g0W2 1 \\f\\s - Its dual space S' (M. d ), the space of all linear, continuous 
functionals on So(IR d ), contains L 2 (R d ) and is a very convenient space of (tempered) 
distributions. Moreover, in the definition of So(IR d ), go can be replaced by any 
g E S (R d ), see [221 Theorem 11.3.7] and different functions g e S (R d )\{0} define 
equivalent norms on ^(M^). 

One of the results of major importance in Gabor analysis states that for g G So(K ) 
the analysis mapping T g is bounded from L 2 (IR d ) to £ 2 for any lattice A, and T* 
is then bounded by duality, see [T5], Section 3.3] for details. This will be of crucial 
significance in our arguments. 



For the construction of quilted frames, we start from a collection of (Gabor) 
frames. Usually, these frames will feature various different qualities, e.g. varying 
resolution quality for time and frequency. Then, a partition in time-frequency is 
set up according to some application-dependant criterion and a particular frame 
is assigned to each member of the partition. For example, in the selection 
of the local frames is based on time-frequency sparsity criteria. Figure [T] gives an 
illustration of the basic idea, for a partition assigning one out of two different Gabor 
frames to each of the tiles of size 64 x 64, where the signal length is L = 256 and 
the number of tiles thus 16. The upper displays show the lattices corresponding 
to the two Gabor frames, the last display shows the "quilted" lattice xi U Xi 
resulting from concatenation. Let us emphasize at this point, that at sampling 
points marked with different symbols, different windows are also used. Note that, 
conceptually, irregular tilings may be used just as well. However, for practical as 
well as theoretical reasons, tilings with some kind of structure are more beneficial. 
It is important to point out that the partition in different domains corresponding 
to various different frames actually happens in the time-frequency domain. This 
implies that a priori we have no knowledge about the properties of the local families, 
as opposed to the concept of fusion frames, as discussed in [7JE]. In particular, we 
are not necessarily dealing with closed subspaces which may be transformed into 
each other as in the approach introduced in |21j . 

We now give a precise definition for quilted Gabor frames. 

Definition 2 (Quilted Gabor frames). Let Gabor frames Q(g\ A^)j e j for h 2 (M. d ) 
and an admissible covering Q r C (B^ r (x r )) re x of M. be given. Define the local 
index sets X T = tt r fl A m ( r \ where m : 1 1— J is a mapping assigning a frame from 
the given Gabor frames to each member of the covering. Then the set 



S (R d ) = {feL 2 (R d ):\\f\\ So 



V go /||Li(K 2d ) < °°}- 



3. Quilted Gabor frames: the general concept 



(4) 
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Figure 1. Partition in time-frequency and resulting quilted lattice 

is called a quilted Gabor frame for L 2 (IR d ) ; if there exist constants < A, B < oo, 
such that 

(5) A\\f\\l<J2J2\(f^W9 m{r) )\ 2 <B\\f\\l 

rex \ex r 

holds for all f G L 2 (R d ). 

The general setting of quilted frames includes, of course, various special cases. 
We first give some trivial examples which may however be relevant in applications. 

Example 1. For a given Gabor frame, we may choose additional sampling points 
in any selected region. This may be helpful, if in some applications, finer resolution 
is only desirable in certain parts of the time-frequency domain. Formally, this may 
be rephrased as follows. We are given Gabor frames Q(g, A 3 ) je N for L 2 (IR d ) with 
A C A J forj G N and Aq the lower frame bound for j = 0. Then, for an admissible 
covering, the local index sets are defined by X r = f2 r fl A m ' r ', where m : X i— > N is 
the mapping selecting the local systems. It is then trivial to see, that the resulting 
quilted Gabor frame has a lower frame bound Aq. The existence of an upper frame 
bound is covered by Theorem^ 
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Example 2. For a given multi-window Gabor frame G({gi, ■ ■ ■ , g n }, A ), additional 
sampling points for selected windows may be added in certain parts of the time- 
frequency domain. For a formal description, assume that an admissible covering 
Q r , r e X, is given and let A C A J forj — 1, . . . , N as in the previous example. The 
mapping m : X — >■ {0, . . . , N} n is given by m(r)(k) — 0, k — 1, . . . , n whenever the 
original lattice is maintained for all windows in the support ofQ r and by m(r)(k) = 
jo, jo £ {1; • • • > N}, if denser sampling correspondong to A J0 is desired in Q r for 
the window g^. 

In the next section we will prove the Bessel property of quilted systems ob- 
tained in a rather general situation, allowing for a finite overlap between the local 
patches. In the construction of lower frame bounds, a certain overlap between 
adjoint patches is often necessary. The two subsequent sections then describe two 
situations, in which a lower frame bound for the resulting quilted Gabor frame can 
be constructed explicitly. 



4. The Bessel condition in the general case 

We prove the existence of an upper frame bound for quilted frames as defined in 
01]). Note that the Bessel property alone allows for interesting conclusions about 
operators associated with the respective sequence, compare [2]. We will deduce 
the Bessel property of quilted Gabor frames from a general statement on relatively 
separated sampling sets. This result generalizes a result given in on the Bessel 
property of irregular time-frequency shifts of a single atom. We prove that an arbi- 
trary function from a set of window functions satisfying a common decay condition 
may be chosen for every sampling point in a relatively separated sampling set to 
obtain a Bessel sequence. 

We assume that different given Gabor systems are to be used in compact sets 
Q r corresponding to the members of an admissible covering of M? d . Under the as- 
sumption that the windows under consideration satisfy a common decay condition 
in time-frequency and that the set of lattices is compact, we claim that an upper 
frame bound, or Bessel bound, can be found. As before, g denotes the Gaussian 
window. 

Theorem 1. Let Gabor frames Q(g^,A^)j e j for~L 2 (W. d ) and an admissible covering 
Q r C (B^i r (x r )) re x of the signal domain be given. Assume further that 

(i) gi € H S) c for all j , where 

H SjC = {ge L 2 (R d ) : \V go g\(z) < C(l + \\z\\ 2 yi}, s > 2d, C > 0. 

(ii) the lattice constants a\fii are chosen from a compact set in M + x R + ; 
i.e. C [a ,ai] C (0, oo) and ft C [/3 , /5 a ] c (0, oo). 

(iii) The regions assigned to the different Gabor systems correspond to an ad- 
missible covering Q r ,r G X with supp(^v) C Q r C Bn r (x r ) for r EX. 
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Let m : X ^ J be a mapping assigning a frame from G{gi , A^)j e j to each member 
of the covering. Then for any 5 < oo, the overall family given by 

(6) G? n = UM\)g m(r) :\ex r c A r , X r = A m « n B Rr+5 } 

possesses an upper frame bound, i.e., is a Bessel sequence for L 2 (R d ). 

Note that the theorem states that in particular the local systems given by X r = 
Q r n A m(r) for all r lead to a Bessel sequence. More generally, however, the local 
patches can uniformly be enlarged by a radius 5. 

We first prove a general statement on sampling of functions in certain Wiener 
amalgam spaces over relatively separate sampling sets. 

Definition 3 (Relatively separated sets). A set X = {zi = G 1} in R 2d is 

called (uniformly) ^-separated, ifio£j,kex,i^tj \ z j~ z k\ = 7 > 0. A relatively separated 
set is a finite union of separated sets. We call X (j, R) -relative separated if the 
number of separated sets is R. 

Remark 1 . It is easy to show that the concept of relative separation does not depend 
on the specific values of 7 and R. In other words, any (7, i?)-relative separated 
set is also a finite union of ^-separated subsets. Of course one has to allow to 
compensate the smallness of rj by a larger number R' = R'{rj). 
There is an equivalent point of view. A sequence is relatively separated in R k if 
and only if for some fixed s > the family {B s (xk))k>i covers each point x in R k 
at most h = h(s) times, uniformly with respect to x. 

Lemma 1. Let 1 < p < 00. Given a pair (7, R) there exists a constant C — C(7, R) 
such that for all (7, -R)- separated sets X and all functions F e W(C°, £ p )(M. 2d ) one 
has F\x is in £ P (X) and 

(7) \\F\x\\*W = (j2 \ F ^)\ P ) < C W F W w(co /P) . 

\xiex J 

Proof: 

Recall that ||F|| w(c°,£p) — ||flfcn||^, where 

a kn = esssup (X)06g |F(a: + k,£ + n)\ = \\F ■ T^xqIU- 

By assumption, X is the finite union of uniformly separated sets X r , r = 1, . . . , R 
and there exists 7, such that min \ zj — Zk\ > 7 > for any pair Zj, Zk in X r , with 
j 7^ k. Hence, for all r = 1, . . . , R, we have at most (1 + ^) 2d points Zi G X r in 
the box (k, n) + Q, (k, n) G Z d x Z d , such that the number of Z{ G X in this box is 
bounded above by R • (1 + I/7). Clearly 

< \\F-T {Kn)XQ \\oo for all G (k,n) + Q. 
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Altogether, this yields: 



(8) "£\F( Zi )\p < R-(i+-y d \\ F - T ( k ,n )X 

1 



p 

, , .,,00 

ry i 

ztex 1 {k,n)e_i? d 



R ■ (1 + ) 11-^11 w(C°,£p) 



□ 



Remark 2. Analogous statements are true in more general situations, especially for 

any weighted sequence space i^, see [19j Lemma 3.8] for example. 

The condition, that F is continuous (locally in C°), guarantees, that sampling 

is well-defined. Of course, weaker conditions, for example, semi-continuity, are 

sufficient. 

The upper frame bound estimate will follow from a point wise estimate over the 
family of short-time Fourier transforms 

(9) F(A) = sup|^/(A)|, XeR 2d 

We will make use of following lemma. 

Lemma 2. Assume that g G M C H S) c for s > 2d, C > 0. Then there exists 
some constant C > such that for all f € L 2 (IR d ) one has the following uniform 
estimate of V g f in W{C°, i 2 ): 

II sup \V g f\\\ w{c °,P) < C1II/II2, for all f el 2 . 

g&M 

Proof: 

The crucial step is to invoke the convolution relation between different short-time 
Fourier transforms ([221 Lemma 11.3.3] ). For convenience in the application below 
let us denote the generic elements from M by g J (instead of go m 11.3.3), and 
make the choice 7 = g = go, the normalized Gauss function go. Then obviously 
(li9) — Ibolll = 1 an d we have the following estimate 

|V^/(A)|< [|V*/| * Ityflbl] (A) 

Since \V g jgo(X)\ = \V go g^(—X)\ < w s (X), we may take the pointwise supremum over 
gi G M on the left side and arrive at 

sup \V g if(X)\<{\V 90 f\*Cw s ){X) 

gj£M 

Of course s > 2d implies that w s G W(C°, ^(M 2 ^. Using the general fact ( [22| 
Cor. 3.2.2] ) that ||V^ /|| 2 < C2II/II2 for any / G L 2 {R d ) and applying the convolu- 
tion relation L 2 * W{C°,£ l ) C W(L\£ 2 ) * W^C ^ 1 ) C W{C°,£ 2 ), together with 
the appropriate estimates, we arrive at the desired estimate. □ 



Remark 3. It is worthwhile to note that the above result is not just a simple 
compactness argument. As a matter of fact it is not difficult to construct compact 
sets M C So(IR d ) for which the above result is not valid. One may, for example, 
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just take a null sequence of the form {c n T Xn g) n >\ for some g G Sb(M d ), and with 
(c n ) G C but (c n ) £ l 2 . 

The next theorem states that for a relatively separated sampling set of time- 
frequency shifts we can construct a Bessel sequence by associating to each sampling 
point an element from H s c- As before, we let M C H s C be a set of window 
functions indexed by J . 

Theorem 2. Let X = {zi = (xi,£i),i G X} m R be a relatively separated set 
of sampling points in M. 2d . Let m : X — >■ J be a mapping assigning a window 
gm(zi) eac fi sampling point. Then the set 

(10) {K{ Zi )g m ^\ieI} 

is a Bessel Sequence for L 2 (R d ). 

Proof: 

We have to estimate the series 

E \(fMzi)g m(Zi) )\ 2 = E \v 9 ^f(zi)\ 2 < E i F (^)i 2 > 

Zi£X Zi£X ZiGX 

with F given by (Q. Now, as shown in the previous lemma, F is in W(C°,£ 2 ). 
Hence, since X is a relatively separated set, Lemma [2] can be applied to obtain the 
following estimate for the Bessel bound of (JTUl) : 

E K/.^Ws^)! 2 < c 2 ^! 1 + i/7) 2 1/ll2 

Zi£X 

□ 

Lemma 3. The union of points {A = (x,£),\ G A' r } m the discrete sets X r as 
chosen in Theorem^ is relatively separated. 

Proof: 

Each of the lattices A r determining the Gabor frames used in the construction of 
is of course separated, even uniformly with respect to r. The admissibility 
condition for (Q r )rei allows only finite overlap between any pair of members in 
the covering, or equivalently that the family of balls of radius R r centered at x r 
forms a covering of (uniformly) bounded height. By assumption, increasing each 
of the balls Bn r (x r ) by the finite radius 5 > 0, only the height of the covering will 
be increased, but not the property of (uniformly) finite height. In other words, 
the family of enlarged balls B^ r+ ^{x r ) is still an admissible covering of R d and the 
union of the X is a relatively separated set. □ 

We conclude the proof of Theorem [1] by choosing M = {g^,j G J} in the 
following Corollary. 

Corollary 1. An upper frame bound for as defined in (0|) is given by C 2 n(5)(l + 
1/7) M 

Note that n(S) denotes the height of the covering, which depends on 5. 
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5. Reduced multi- window Gabor frames: windows with compact 

support or bandwidth 

In this section, we show that in a specific situation, which is, however, of practical 
relevance, quilted Gabor frames may be constructed. In the present model, we only 
change the resolution in time (or frequency). This means, that the time- frequency 
domain is partitioned into stripes rather than patches. Under the additional as- 
sumption that the analysis window has compact support (or bandwidth), we easily 
obtain a lower frame bound for the quilted system. 

Assume that we are given Gabor frames Q(g j ,A j ) for L 2 (M d ), j G J, where all 
the windows gi have compact support and ||<? J ||s < C g < ooVj. We now want to 
use each system for a certain time, i.e., in a restricted stripe in the time- frequency 
domain. The stripes are defined by means of a partition of unity: we assume that 
/ = Ylrex^rf with ip r < 1 and that the ip r have compact support in [a r ,6 r ]. By 
means of a mapping m : X — > J , we assign one particular frame to each of these 
stripes. 

Now, subfamilies of the given Gabor frames may be constructed as follows. As- 
sume, for simplicity, that m(0) = and consider the task to represent ipof in terms 
of the given Gabor frame Q(g°,A°): 

M =^o(E(/,7r(A)s°M%°) 

AGA° 

= ^2(f^W9°)^(\)g°. 

AeA" 

Now, there exist Uq and n l such that for A = (na , m(3 ) with n [n l , Uq], we find 
that ip 7r(\)g° = 0, hence 

M= ^ </, 7r(A)2> 7r(% , 

where Xq = [n l ■ «o? n o • «o] x /^o^ is the subset of A corresponding to the nonzero 
contributions. 

Analogously subsets X r C A m< - r ^ are chosen for all r, and we obtain: 

(ii) / = = E E (fMV9 m{r) WM\)g m{r) . 

With this construction, we state the following proposition. 

Proposition 1. For a family of tight Gabor frames Q{g^,PJ), j e J , for L 2 (M d ) 
let sup jex \\gi\\ So = C g < oo and C AJ = (± + l) d ( j- + l) d <C A <oo for all j e J. 
Let a partition of unity (ip r )rei of compactly supported ip r with height no be given 
and let a mapping m : X — > J assign a frame Q(g rn(j \ A m ^) to each r G X. Assume 
that index sets X r = [n l r -a m ( r ), n%-a m ( r )] x /5 m ( r )Z are chosen such that for all r GX 
and A = (na m ^ r ),m/3 m ^) with n [n l m ^, n^ (r) ] ; we have that i(; r 7r(X}g' m( - r ^ = 0. 
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Then, the union of the subfamilies {_) r& z(9 m ^ •> a frame for L 2 (M d ) with a 

lower frame bound given by l/(n C\Cg). 

Proof: 
First note that 

(12) WAHl < \\h\\l for all he~L 2 (R d ) 

Now set h r = J2\exr(f,7r(\)g mir) )7r(\)g m{r) and thus, with 

12 <n J2 W^rfWt 



="o£ll E (f^W9 m{r) )Arr(X)g m{r) \\l 

r XeX r 

=n J2\\hM\l <n J2W E (/^(A)^ m(r V(A)^ 

^E(^ + 1 ) d (^ + 1 ) d ^ m(r) ^o E i(/^(% m(r) )i 



m(r) II 2 
1 1 2 



r J \ex r 
<^2El(/'^ m(r) )| 2 

r XeX r 

The last inequality is due to the boundedness of the frame-synthesis operator 
T* m(r) : £ 2 (Ai) L 2 (R d ), whenever the window g m ^ is in S {R d ), see [221 Propo- 
sition 6.2.2]. This proves the existence of a lower frame bound as stated. The 
existence of an upper frame bound can be seen directly from the construction of 
the subfamilies, and is furthermore covered by the general case proved in Section HJ 
□ 

Remark 4. (1) An analogous statement holds for general, not necessarily tight 
frames, for, if 7 J are the dual windows for each g\ then \S^ x g 3 \ < ;^-||<7 J |||. 

(2) The same construction may be realized in the Fourier transform domain 
by applying a partition of unity to /. This corresponds to the usage of 
different Gabor frames in different stripes of the frequency domain and 
hence resembles a non-orthogonal filter bank. As a particular example, a 
constant-Q transform may be realized [5]. 

(3) Note that a similar yet more restrictive construction, corresponding to the 
classical "painless non-orthogonal expansions" was suggested in [21]. Very 
recently, another related and highly interesting construction has been sug- 
gested in 



6. Replacing a finite number of frame elements 

We now consider the task of replacing a finite number of atoms from a given 
(Gabor) frame by a finite number of atoms from a different (Gabor) frame. The 
following theorem gives a condition valid for general frames, which will then be 
applied to Gabor frames. Recall, that T g and T* denote the analysis and synthesis 
mapping, respectively, for given g and A. In this section, we use the notation 
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Tgj; and T* x for the respective mappings corresponding to subsets of the given 
lattices. For example, let T\ C A be a finite subset of a lattice A, then T g ^ x (/) = 
(f,ir(X)g), for A G T\. The theorem makes use of a linear mapping L describing 
the replacement procedure in the coefficient domain. As long as elements from 
frame Q\ may be replaced by elements from Q 2 in a controlled manner, i.e. without 
loosing energy, a quilted frame can be obtained. 

Theorem 3. Assume that two frames Q\ = {gi,i G X} and Q 2 = {hj,j G J} for 
L 2 (M d ) are given and a finite number of elements {gi,i G T\ C X} of Q\ are to be 
replaced by a finite number of elements {hj,j G Ti C J} of Q 2 - 
Let Ai be the lower frame-bound of Q\. If a bounded linear mapping L : P'iTx) 
£ 2 (J-2) can be found such that 

(13) IK^-T^LWl^CK^, 
then the set 

(14) {.9i,i G X\J r i} U {hj,j G J2} 

is a frame for L 2 (R d ) a lower frame bound given by (A\ — 2C)/ max(l, 2||L*|||). 

Proof: 
First note that 

M\f\\l< E i</^>i 2 +EK^>i 2 HIWJ2+ iit^j 2 .. 

jei\J r i ieJ 7 ! 

Now, we have 

\\T 9 ,tA\1 < (\\(T g ^-L*T h>T2 )f\\ + \\L*T h ^f\\) 2 

<2.\\(T 9 , Tl -L*T h ^)f\\l + 2.\\L*T h ^\\ 2 2 
<2.C-\\f\\l + 2-\\L*T h ^f\\l 

hence 

(A 1 - 2C)\\f\\l < \\T ATl f\\l + 2 ■ ||L1 2 ||TW|| 2 

<max(l,2||L*|| 2 )-( E \(f,9i)\ 2 + E K/> 

and hence (Ai — 2C)/ max(l, 2||L*|||) is a lower frame bound for the system given 
in (I14p . The existence of an upper frame bound is trivial. □ 

Note that the above theorem only states the existence of a lower frame bound under 
the given conditions, while this frame bound will usually not be optimal. 
We now turn to the special case of Gabor frames. 

Corollary 2. Assume that tight Gabor frames Q(g,A 1 ) and Q(h,A 2 ) with g,h G 
So(K d ) are given. Assume further that in a compact region Q C M. 2d the time- 
frequency shifted atoms ir(\)g, A G T\ = Q n A 1 are to be replaced by a finite set 
of time-frequency shifted atoms 7r(n)h, fi G T% C A 2 . 
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(a) If A 1 = A 2 , then 
(15) G = MX)g : A e A \ JFx} U {*(ji)h : fi e ft} 

is a (quilted Gabor) frame for L 2 (M d ), whenever 



i*- 9 |l! b =o<A, 



where C A is a constant only depending on the lattice A = A 1 = A 2 , 
(b) For general A 2 , a compact set Q* in R 2d can be chosen such that for T 2 = 
Q* Pi A 2 ; the union 

(16) Q = {n(X)g : A G A 1 \ Ji} U {tt(^)/i :^J 2 } 

zs a (quilted Gabor) frame. 

Proof: 

Statement (a) can easily be seen by choosing L = Id in Theorem [3j 

\\ T k - T k\\%^m = su p II Yl c ^ n ( x )9 - n ( x ) h )\\l 

H C H 2=1 Ae^i 
<C A - \\h-g\\ 2 So , 

where the last inequality follows from boundedness of the synthesis operator for 
windows in So, [221 Theorem 12.2.4]. 

To show (b), we first introduce the mapping L : ^ 2 (J r i) H- ^ 2 (-7~2) as follows. For 
a finite sequence c = (c A )Ae^ 1 we define L(c)(fx) = ((J^xe^i C ^( X )9, ^{f^h))^^ 
for which 

\\L\\p {Tx) ^ P{T2) = sup I c A (^(A)^,7r(^)^)| 2 

= \\ T h,F 2 T* ^Wl < C A iC A 2 ■ ||p||| ||/i||| 

due to the boundedness of synthesis and analysis operator, Th t r 2 an d T*^ , respec- 
tively. We then have: 



|T^ -T^ 2 L|| £ 2^ L 2 (IRd) = sup || Y catt(A)^- (c\n{X)g, 7f (fi)h)-K(fi)h\\ 2 

ll c ll 2=1 AeJ"i neft Ae.Fi 

SUP || Y ^M^^fX^M/^lh 



II C H 2_1 ^eFf AeFi 

< \\h\\ 2 sup |c A | • \V g h(fi - A) | 

H c ll 2=1 /ieJ r 2 c AeFi 

< ||/i|| 2 a/I-^iI ^ max |V s /i(/i — A) | 

^eF| AeJri 



where = A 2 \J r 2 - Now an appropriate set T 2 may be constructed as follows: 
Let G = \V g h\ e W^J 1 ). We can choose a compact set Q* C R 2d , such that 

II max(TAG — (T\G) ■ Xn*)\\w < £ 
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where xn* 1S the indicator function of the set fl Now set 

7 2 = A 2 n n*, 

then 

EmaxT A G(/z) = ||(maxT A G)| \\ e i 

= \\max(T x G -T X G ■ xn*)\ h2 \W 

AG Tx 1 A 

(17) < C A 2 ■ \\{T X G - T X G ■ Xn*)\\w(co,fi) 



< C\2 ■ e = C\2 ■ — 

y/2\n\\\h\\ 2 C A *' 

where we used Lemma [1] in (ITT)) . Hence, J-2 can be chosen, such that 

Of course, the existence of an upper frame bound is trivial and the resulting system 
(IT6)) is a quilted Gabor frame according to Theorem [3j □ 



Remark 5. (1) The size of the region in which atoms from Q\ have to be replaced, 
influences the choice of Q*. In particular, e is reciprocally related to yj^ij", i.e., 
Q* grows in dependence on the perimeter rather than the area of Q. 

(2) For statement (a) in Corollary [2], if g, h 6 L 2 (M d ), then the frame property 
follows whenever 

\\h-g\\l =C<A l /(2\JF 1 \). 

Note that the size of Q determines the necessary similarity of the windows, whereas, 
for windows in Sq(R ), the good localization implied by So-membership allows for 
a stronger statement. 

(3) The construction in Corollary [2] implies explicit dependence on time and fre- 
quency of the resulting quilted frame. Similarly, Gabor atoms in finitely many 
compact areas can be replaced by different Gabor systems. Details on this proce- 
dure will be reported elsewhere. From an application point of view, this process 
corresponds to finding optimal representations for local signal components, e.g. in 
the sense of sparsity. 

(4) In Example [TJ the linear mapping L : A — > M X r can be chosen as follows: 



L(c)(A) 

Then 



for A G A 

for A G U^ r \A° 



ll T lo,,-^ r ^L|| 2 = sup || ]Tc A 7r(A)2- L(c)(\)n(\)g\\l = 0. 

I|ci|2_1 AeA° Ae|J r A' r 

As underlined by Example UJ and Corollary [2]^a), in constructing quilted Gabor 
frames, technically difficult situations mainly arise if the lattices and the windows 
vary. 
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Tight window for a=4 



Tight window for a=S 
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Figure 2. windows corresponding to four different Gabor frames 



7. Reconstruction and Simulations 

Since the frame property has been proved for systems as described in Propo- 
sition [TJ and Corollary [2} reconstruction can always be performed by means of a 
dual frame. However, since quilted Gabor frames possess a strong local structure, 
alternative and numerically cheaper methods may be preferable as long as sufficient 
precision in the reconstruction may be guaranteed. The next two sections present 
numerical results for various approaches to reconstruction for which the calculation 
of an exact dual frame is not necessary. 

7.1. Reduced multi- window Gabor frames. We first consider reduced multi- 
window Gabor frames. Here, equation (ITT]) yields an immediate reconstruction for- 
mula by means of projections onto the members of the partition of unity. However, 
we are more interested in the generic reconstruction by means of dual frames. We 
may compare the dual frame corresponding to the quilted Gabor frame Ujex^"'' ^i) 
with the quilted system Ujer(7i> ^j) resulting from using the dual windows jj of 
the original frames Qj. Alternatively, we may start with tight Gabor frames. 
While this approach does not result in perfect reconstruction in one step, we apply 
the frame algorithm (see [22] Chapter 5]) to obtain near-perfect reconstruction in a 
few iteration steps. In this context, the condition number of the operators involved 
plays an important role and depends on the amount of overlap that we introduce 
in the design of the system. In the following example, it turns out that, while 
no essential overlap is necessary to obtain a frame in the finite discrete case, the 
overlap as requested in the proof of Proposition UJ leads to faster convergence of 
the frame algorithm. 

Example 3. We consider two tight Gabor frames for C L and L = 144 and two 
cases of different redundancy. First, redundancy is 4.5, corresponding to the lat- 
tices A 1 with a = 4, b = 8 and A 2 with a = 8, b = 4. Second, we consider two frames 
with redundancy 1.125, corresponding to the lattices A 1 with a = 8,b = 16 and 
A 2 with a = 16, b = 8. The corresponding tight windows are shown in Figure |5J 
We next generate a quilted Gabor system without overlap and a corresponding 
Gabor system with overlap, for both cases of redundancy. Note that in each lattice 
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High redundancy, no overlap 
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Figure 3. Various lattices with different amounts of overlap 
Table 1: Condition number of four quilted Gabor frames 



Redundancy 


No overlap 


Overlap 


4.5 
1.125 


1.6 
6.4 


1.4 
1.5 



Table 2: Number of iterations for convergence of frame algorithm 



Redundancy 


No overlap 


Overlap 


4.5 
1.125 


21 
322 


17 
18 



point as depicted in Figure EJ the tight window of the original Gabor frame is used. 
We now look at the condition numbers of the resulting quilted systems, listed in 
Table 1. It is obvious, that higher redundancy leads to more stability in the pro- 
cess of quilting frames. On the other hand, for the system with low redundancy, 
overlap becomes essential in order to obtain acceptable condition numbers. These 
observations are consistently confirmed by more extensive numerical experiments. 
In a next step, we now compare the convergence of the (iterative) frame algorithm 
for the 4 cases considered in this example. Table 2 gives the number of iterations 
necessary to attain the threshold of 10 -8 . Figure H] then shows the rate of conver- 
gence for the three cases with acceptable conditions numbers. 
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Figure 4. Convergence of frame algorithm 



We finally discuss the following, "preconditioned" version of reconstruction for 
the case of low redundancy with overlap. We wish to reconstruct a random signal 
r E C L from its quilted Gabor coefficient. As a first guess, instead of calculating 
the dual frame of the quilted frame, we simply use the quilted tight frame for 
reconstruction: Let Tgt denote the analysis operator corresponding to the quilted 

tight frame Q l q = Uj=i(^j> Xj), where hj are the tight windows. We then obtain a 
reconstruction rec by 

rec = T%t ■ Tgt ■ r. 

Obviously, the result is not accurate and in particular in the regions of transition 
between the two systems, errors occur. However, we can correct a considerable 
amount of the deviation from the identity by simply pre-multiplying the frame- 
operator by the inverse of its diagonal. Hence, let D be the diagonal matrix with 
D(n, n) = Tgt ■ T g t(n, n), n = 1, . . . , 144. 

rec = T* gtq ■ Tgt ■ D~ l ■ r. 

The respective results are shown in Figure The relative error, defined by e = 
llziggzrll i s then 0.2239 for the uncorrected case and 0.032 for the corrected version. 

\\r\\ 

7.2. Replacing a finite number of elements. In our next example we consider 
a situation similar to the one discussed in Example El however, this time we wish 
to replace elements from Qi in a bounded, quadratic region of the time-frequency 
plane. 

Example 4. We consider the same Gabor frames as in Example El and look at the 
high redundancy systems first. As before, we compare the condition number of the 
system obtained with overlap to the less redundant situation. The two situations 
are shown in Figure [6j The quilted Gabor frame without overlap has condition 
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Reconstruction without preconditioning 
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Reconstruction with preconditioning 




Figure 5. Reconstructed random signal 
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20 40 60 80 100 120 20 40 60 80 100 120 

Time Time 

Figure 6. Replacing atoms with and without overlap, high redundancy 

number 1.5, while allowing for some overlap, as shown in the second display of 
Figure [6] leads to condition number 1.4. Accordingly, 18 and 17 iterations are 
necessary for convergence of the frame operator. 

We now turn to the systems with low redundancy. Here we compare three amounts 
of overlap as shown in the upper displays of Figure [7J The condition numbers of 
the resulting systems and the convergence behavior of the corresponding frame 
algorithm are shown in the lower display of the same figure. Again, it becomes 
obvious that for low-redundancy systems, overlap is essential in order to obtain 
fast convergence in iterative reconstruction. On the other hand, increasing overlap 
beyond a certain amount, does not dramatically improve the condition numbers. 
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Figure 7. Replacing atoms with and without overlap, low redundancy 

8. Summary and Outlook 

We have shown the existence of a lower frame bound for two particular instances 
of quilted Gabor frames. Furthermore, an upper frame bound has been constructed 
for the general setting. We showed how to reconstruct signals from the coefficients 
obtained with quilted Gabor frames and numerical simulations have been provided. 
Future work will mainly include the construction of lower frame bounds for more 
general situations. In particular, Proposition [1] will be generalized to Gabor frames 
with non-compactly supported windows. Furthermore, numerical simulations sug- 
gest that atoms from a given Gabor frame may be replaced by atoms from a dif- 
ferent frame in infinitely many compact regions of the time-frequency plane under 
certain conditions. On the other hand, for practical applications algorithms appli- 
cable for long signals (number of sampling points ^> 44100) have to be developed. 
The results of processing with quilted Gabor frames will be assessed on the basis 
of real-life data. Preconditioning similar to the procedure suggested in Example [3] 
can be developed for the more complex situations of quilted frames, compare [3]. 
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